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ABSTRACT 


The  performance  of  test  pilots  and  college  student  subjects  in  acquiring  the  skill 
o  control  the  attitude  of  a  simulated  space  vehicle  was  compared.  The  purpose  of  the 
comparison  was  to  investigate  transfer  of  training  to  this  type  of  task  as  a  function 
of  prior  pilot  experience  and  determine  the  degree  to  which  one  may  generalize  from 
students  to  pilots.  There  was  also  a  further  breakdown  of  the  student  group  into  experi¬ 
mental  subgroups  to  assess  the  effects  of  type  of  control/display  relationship  and  the 
order  of  part  training  on  the  acquisition  of  the  vehicular  control  task.  The  secondary 
comparisons  within  the  student  group  were  to  determine  optimal  training  conditions  to 
make  the  comparison  with  the  pilots  as  equitable  as  possible.  The  conclusions  based 
on  the  results  of  the  study  were  (1)  there  appear  to  be  more  positive  transfer  effects 
than  negative  in  transitioning  from  flying  aircraft  to  a  simulated  inertial  control  task; 

(2)  the  degree  to  which  generalizations  can  be  made  from  students  to  pilots  depends 
on  the  amount  of  training  given  the  students  provided  an  optimal  control/display  rela¬ 
tionship  is  used;  (3)  previously  untrained  subjects  can  achieve  skill  levels  comparable 
to  pilots  on  this  type  of  task,  but  it  takes  more  trials  for  the  nonpilot  to  do  so;  (4)  order 
of  part  training  does  not  appear  to  be  an  important  variable  in  training  on  this  type  of 
task . 
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SECTION  I 


INTRODUCTION 


One  of  the  more  critical  areas  in  the  space  pilot's  training  program  is  that  of  vehic¬ 
ular  control.  The  orbiting  space  vehicle,  unlike  the  conventional  aircraft,  operates  in 
an  undamped  or  frictionless  environment;  this  makes  its  control  dynamics  somewhat 
unique.  In  the  aerodynamic  vehicle,  attitude  is  controlled  largely  by  the  interaction 
between  control  surfaces  and  the  atmospheric  envelope,  which  constantly  exerts  a  force 
on  the  vehicle.  Whereas,  the  inertial  or  space  vehicle's  attitude  must  be  controlled 
through  internal  forces  furnished  by  small  reaction  jets  positioned  along  the  various 
axes  of  the  craft,  since  there  are  no  external  forces  or  damping  acting  on  it  (for  this 
reason  the  control  that  activates  these  jets  is  called  a  reaction  control) .  This  difference 
in  system  dynamics  (aerodynamic  vs  inertial)  in  turn  has  led  to  changes  in  the  pilot's 
control  task.  In  the  aircraft,  the  pilot's  task  in  controlling  the  attitude  of  the  vehicle 
is  a  rate  control  task,  i.e.  ,  a  given  amount  of  displacement  of  the  control  stick  imparts  a 
given  pitch  or  roll  rate  to  the  vehicle  and  when  the  control  is  returned  to  the  neutral 
or  null  position  the  vehicle  tends  to  stabilize  at  some  given  attitude  due  to  aerodynamic 
damping.  On  the  other  hand,  the  attitude  control  task  in  the  orbiting  space  vehicle  is 
one  of  acceleration  control,  i.e. ,  for  a  given  displacement  of  the  control  a  constantly 
increasing  rate  of  change  of  pitch  or  roll  takes  place.  When  the  control  is  returned  to 
the  null  position  the  angular  position  of  the  vehicle  continues  to  change  at  whatever 
rate  happens  to  exist  at  the  time  the  control  is  nulled.  Furthermore,  to  stabilize  the 
vehicle  at  a  given  attitude  one  must  exert  a  control  movement  in  the  opposite  direction 
for  an  equal  amount  of  time  to  cancel  out  the  first  control  input  as  the  vehicle  approaches 
the  desired  angular  position.  Thus  the  attitude  control  task  in  the  spacecraft  is  more 
of  a  timing  response  rather  than  a  positional  response  as  in  an  aircraft.  This,  of  course, 
is  discounting  the  proportional  reaction  control  where  amount  of  control  displacement 
does  vary  intensity  of  thrust  which  interacts  with  the  temporal  variable.  For  purposes 
of  this  investigation  we  will  be  interested  in  the  discrete  or  fixed-thrust  type  of  reac¬ 
tion  control. 

Another  characteristic  of  the  astronaut's  control  task  that  differentiates  it  from  that 
of  the  aircraft  pilot's  task  is  the  increased  sensitivity  of  vehicle  response  to  control 
inputs.  This  increased  sensitivity  can  induce  the  pilot  to  over-control  the  inertial 
vehicle. 

In  summary,  there  are  three  basic  differences  between  the  aerodynamic  control 
task  and  the  inertial  control  task:  (1)  rate  control  vs  acceleration  control;  (2)  increase 
in  sensitivity  of  control;  and  (3)  use  of  an  on/off  reaction  control.  Because  of  these 
differences  in  skills  required  of  the  astronaut,  extensive  prior  experience  in  flying 
aircraft  may  not  be  of  special  advantage  and  in  some  cases  may  even  yield  negative 
transfer  effects.  If  extensive  training  as  a  pilot  is  of  no  great  advantage  with  respect 
to  vehicular  control  skill,  the  population  of  potential  astronauts  might  be  greatly 
expanded.  It  would  also  enable  younger  men  to  be  trained  as  astronauts  and  make  it 
much  easier  to  train  the  scientist  as  an  astronaut  rather  than  vice  versa. 

The  primary  purpose  of  this  study  was  to  compare  the  performance  of  a  nonpilot 
group  of  college  students  with  a  group  of  Air  Force  test  pilots  in  the  acquisition  of  a 
two-dimensional  attitude  control  task  in  a  simulated  inertial  vehicle.  This  would  make 
it  possible  to  determine  how  successfully  nonpilot  personnel  can  master  such  a  skill, 
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identify  areas  of  positive  or  negative  transfer  in  the  pilots,  and  determine  the  degree 
to  which  one  may  generalize  research  findings  to  pilots  in  this  type  of  task.  A  second¬ 
ary  purpose  was  to  determine  optimal  control/display  (C/D)  relationships  for  the  student 
group  to  insure  that  differences  between  students  and  pilots  would  not  be  magnified  by 
an  unfavorable  C/D  relationship.  According  to  studies  done  by  Loucks  (refs  1  and  2), 
Grether  (ref  3),  and  Gardner  (ref  4),  the  C/D  relationship  affects  performance  on  a 
tracking  task  of  this  type,  especially  in  naive  subjects.  Order  of  part  training  in  each 
one  of  the  single  dimensions  was  also  investigated  to  control  for  differences  in  diffi¬ 
culty  between  the  pitch  and  roll  axes  and  to  observe  differential  transfer  effects,  if 
any,  between  the  two.  The  second  phase  of  the  study  was  also  undertaken  to  determine 
optimal  training  techniques  for  students  to  be  used  in  future  research. 


SECTION  II 


APPARATUS  AND  PROCEDURE 

The  apparatus  for  conducting  the  experiment  was  a  simulation  of  the  attitude  control 
system  of  an  inertial  vehicle  and  included  a  nonproportional  reaction  controller  which 
controlled  an  attitude  display  complex  that  depicted  the  dynamics  of  the  simulated 
spacecraft.  However,  due  to  design  limitations  imposed  by  the  equipment  available 
at  the  time,  a  two-axis  control  and  display  were  used  instead  of  a  three-axis  control 
and  display;  thus  pitch  and  roll  were  the  only  two  dimensions  simulated.  The  entire 
system,  called  the  Vehicular  Control  Apparatus  (VCA)  consisted  of:  (1)  a  Donner  Model 
3000  Analog  Computer,  which  provided  the  dynamics  for  the  attitude  display,  and 
simulated  the  fuel  system,  and  drove  the  fuel  and  rate  meters  used  in  the  subject's 
display  panel;  (2)  a  Servosystem  to  drive  the  attitude  display;  (3)  a  two-axis  sidearm 
reaction  control  stick;  (4)  an  experimenter's  control  panel  with  a  sequence  programmer; 
(5)  various  power  supplies  for  the  servo  and  display;  (6)  electromechanical  timing 
apparatus  for  measuring  time-off-target;  and  (7)  a  subject  display  panel.  The  computer 
program  and  diagram  of  the  apparatus  are  shown  in  figure  1 .  The  entire  setup  can  be 
seen  in  figure  2. 

The  subject's  display  panel  shown  in  figure  2  consisted  of  a  standard  Air  Force 
MM-4  attitude  indicator,  which  was  the  primary  display,  flanked  by  a  secondary 
display  of  two  voltmeters  which  informed  the  subject  of  the  rate  of  angular  velocity 
of  the  primary  instrument  and  also  provided  information  on  direction  of  the  angular 
velocity.  Thus,  the  display  was  partially  quickened  to  make  the  task  less  difficult. 
Also  mounted  on  the  panel  were  a  red  and  a  green  light  which  served  as  "Ready"  and 
"Go"  signals,  respectively.  The  red  light  was  illuminated  when  the  fuel  meter  read 
zero,  which  was  between  trials,  or  when  the  subject  consumed  all  his  fuel  during  a 
trial,  in  which  case  the  trial  was  terminated.  Following  the  intertrial  interval,  the 
red  light  was  extinguished,  and  this  acted  as  a  ready  signal  followed  by  the  illumina¬ 
tion  of  the  green  light  which  was  the  signal  for  the  subject  to  begin  tracking.  Both 
lights  were  extinguished  when  the  subject  had  successfully  completed  the  task.  A 
fuel  gauge  and  an  elapsed  time  meter  were  also  provided  to  give  the  subject  feedback 
on  amount  of  fuel  and  time  expended  in  achieving  the  criterion. 

The  sidearm  two-axis  reaction  control  stick  (also  shown  in  figure  2)  was  spring 
loaded  with  positive  centering  and  had  two  roller-actuated  microswitches  mounted  on 
aach  axis — one  for  each  direction  of  stick  motion  (roll  left  or  right  and  pitch  up  or 
down).  Stick  displacement  through  1°  of  arc  in  any  direction  actuated  the  switches 
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Figure  2.  Vehicular  Control  Apparatus 
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by  means  of  sliding  cams.  The  switches  were  connected  to  the  computer  and  activated 
the  simulated  reaction  jets.  The  output  of  the  jets  was  then  fed  into  the  computer 
simulation  of  the  vehicle  dynamics  and  ultimately  to  the  display.  Actuation  of  the 
switches  also  caused  the  system  to  expend  fuel.  (See  figure  3.) 

The  d-c  output  of  the  computer  was  chopped  and  fed  into  the  a-c  servosystem, 
which  was  wired  as  a  velocity  servo.  The  servomotor  was  mechanically  coupled  to  a 
control  transformer  whose  output  was  transmitted  to  the  MM-4  indicator,  which  repeated 
the  motion  of  the  control  transformer. 

The  device  for  measuring  time-off-target  functioned  in  the  following  manner:  a 
photoresistor  was  mounted  opposite  a  light  source  so  that  whenever  the  light  hit  the 
resistor  it  lowered  its  value;  this  acted  as  a  switch  to  turn  off  a  Hunter  Klock  Counter. 
Intervening  between  the  photoresistor  and  the  light  source  was  a  slotted  gear  that 
operated  off  the  servomotor  shaft  so  that  when  the  shaft  of  the  motor  was  in  a  given 
angular  position,  designated  by  the  experimenter  as  the  target  attitude,  the  slot  would 
be  opposite  the  light  source  causing  the  photoresistor  switch  to  open.  Thus,  as  long 
as  the  subject  was  off  target,  the  electronic  counter  would  run,  and  whenever  the 
subject  was  on  target,  the  counter  would  stop.  Criterion  attitude  in  each  dimension 
was  sensed  using  the  photoresistors  and  total  time-off-target  for  the  combined  dimen¬ 
sions  was  recorded  by  a  third  counter  that  was  controlled  by  a  relay  on  the  experi¬ 
menter's  control  panel.  Whenever  the  subject  was  on  target  for  the  prescribed  criterion 
time  interval,  the  experimenter  switched  the  VCA  into  a  "Hold"  condition,  which  stopped 
the  total  elapsed  time  counter.  A  diagram  of  the  scoring  apparatus  is  shown  in  figure  4. 
The  experimenter's  console  also  contained  a  series  of  Hunter  timers  and  associated 
relays  that  automatically  programed  the  sequence  of  events  that  constituted  a  trial. 

The  subject's  task  was  to  stabilize  the  attitude  display  at  zero-degrees  pitch  and 
zero-degrees  roll  simultaneously  for  a  period  of  2  seconds  by  means  of  control  inputs 
from  the  two-axis  control  stick.  The  subject  was  seated  at  a  viewing  distance  of  60  cm 
from  the  primary  display.  A  set  of  initial  conditions  was  programed  on  the  computer  to 
initiate  the  problem  for  the  subject.  The  sequence  of  events  in  a  given  trial  was  as 
follows:  (1)  red  "Abort"  light  went  off;  (2)  the  display  was  activated  at  an  angular  rate 
of  40°/sec  in  the  pitch  and/or  roll  dimension;  and  (3)  5  seconds  later  the  green  "Go" 
light  came  on  and  the  subject  began  tracking  the  display.  When  the  subject  achieved 
criterion,  the  computer  was  switched  into  a  "Hold"  condition  and  the  experimenter 
recorded  the  elapsed  time  and  amount  of  fuel  remaining.  The  experimenter  then  com¬ 
puted  the  ratio  score,  a  combination  measure  of  the  two  scores  (see  method  of  scoring 
below),  and  verbally  relayed  this  to  the  subject.  Following  feedback  to  the  subject, 
there  was  a  20-second  intertrial  interval,  and  the  sequence  was  repeated  until  the  end 
of  an  experimental  session. 

Experimental  Design 


The  study  was  conducted  in  two  phases,  the  first  being  the  comparison  within  the 
student  group  of  the  control/display  relationship  and  the  order  of  part  task  training  on 
the  acquisition  of  the  two-axis  attitude  control  task.  The  first  phase  was  a  three- 
factor  repeated  measures  design  (Case  II)  as  described  by  Winer  (ref  5)  or  a  Lindquist 
Type  III  mixed  factorial  design  (ref  6) .  The  order  of  part  task  training  was  varied  in 
two  ways — training  on  the  pitch  dimension  only  was  preceded  by  training  on  the  roll 
dimension  or  vice  versa.  Control/display  relationship  was  also  varied  in  two  ways — 
outside-in  vs  inside-out,  i.e. ,  direction  of  movement  of  the  display  was  in  the  direc¬ 
tion  of  stick  displacement  in  the  former  and  the  opposite  of  stick  displacement  in  the 
latter.  Six  subjects  were  randomly  assigned  to  each  of  the  four  groups  for  a  total  of 
twenty- four  subjects. 
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Figure  3.  Schematic  Diagram  of  Analog  Circuitry 
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Figure  4 .  Diagram  of  Scoring  Apparatus 
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Each  subject  was  given  a  total  of  192  training  trials  over  a  span  of  six  experimental 
sessions  equally  spaced  over  a  12-c.ay  span  (every  other  day) .  An  experimental  session 
consisted  of  two  16-trial  blocks  separated  by  a  20-minute  rest  period  for  a  total  of  32 
trials  per  session.  The  first  two  and  one-half  sessions  were  devoted  to  part  task 
training  for  a  total  of  80  trials  of  part  task  training.  For  any  given  subject,  the  first 
32  trials  were  spent  on  the  one  dimensional  task  (pitch  or  roll)  followed  by  the  second 
experimental  session  in  which  the  subject  was  trained  on  the  other  dimension.  In  the 
third  part  task  training  session  (one-half  experimental  session),  the  subject  was  given 
8  trials  on  each  dimension.  Following  the  part  task  training,  the  subject  was  given 
112  trials  on  the  two-dimensio  il  control  task  in  the  remaining  three  and  one-half 
experimental  sessions.  Prior  to  each  experimental  session,  the  subject  was  briefed 
on  the  task  for  that  session  as  to  procedure  to  be  followed.  One  practice  trial  was 
permitted  on  each  of  the  part  task  experimental  sessions  and  on  the  first  experimental 
session  of  the  two-dimensional  task. 

The  comparison  of  the  pilots'  and  students'  performance  was  treated  as  a  two- factor 
experiment  with  repeated  measures  on  one  factor. 

In  contrast  to  the  students,  the  pilots  were  given  only  the  inside-out  control/display 
relationship  and  cnly  one  condition  of  part  task  training;  the  pitch  dimension  was  pre¬ 
sented  first.  This  was  done  for  several  reasons,  the  most  important  being  that  the 
population  of  available  test  pilots  is  extremely  limited  for  experiments  requiring  six 
separate  experimental  sessions  over  a  12-day  span.  (Four  subjects  were  lost  because 
of  other  commitments  after  having  started  the  experiment.)  Also,  order  of  part  task 
training  had  no  effect  on  acquisition  in  the  first  (student)  phase  of  the  experiment. 

(See  results.)  The  outside-in  control/display  relationship  was  avoided  because  it  is 
a  reversal  of  the  C/D  relationship  in  operational  aircraft,  and  simulator  training  on  an 
opposite  relationship  might  interfere  with  the  pilot's  flying  on  the  job  and  thus  pose  a 
safety  hazard. 

Method  of  Scoring 


Acquisition  of  a  perceptual  motor  skill,  such  as  we  have  in  this  task,  is  usually 
measured  in  one  of  two  ways:  (1)  the  minimal  physical  effort  required  to  accomplish 
the  task  or  (2)  minimal  time  required  to  meet  a  criterion  performance.  Frequently  one 
measure  takes  its  toll  on  the  other,  i.e.  ,  speed  is  usually  sacrificed  for  efficiency 
and  vice  versa.  In  the  vehicular  control  task  used  in  this  study  the  amount  of  fuel 
consumed  was  the  measure  of  efficiency  (the  less  fuel  used  the  fewer  the  control  inputs). 
Time  to  criterion  was  the  other  measure  of  skill.  To  insure  that  the  subject  would 
accomplish  the  task  in  a  maximally  skillful  manner  using  both  minimal  fuel  and  time, 
a  combination  of  the  two  measures  was  used  in  assessing  the  subject's  skill  level,  and 
this  information  was  given  to  the  subject  following  each  trial. 


The  combination  measure  employed  was  called  a  ratio  score  and  was  computed  by 
ne  following  formula: 


Ratio  Score 


Elapsed  Time  in  Seconds 
%  Fuel  Remaining 


x  100 


;e  lower  the  score  the  better  the  subject's  skill  level.  For  example,  if  a  well-trained 
subject  achieved  criterion  in  18  seconds  and  used  10%  of  his  fuel  (90%  remaining)  his 
.core  would  be  computed  in  the  following  manner: 


•  SC** ■ 


8 


1  8 

—  x  100  =  .  2  x  100  =  A  ratio  score  of  20 . 

9  U 

Using  this  method  of  scoring,  time  is  relatively  more  important,  but  only  so  long  as 
fuel  consumption  is  kept  to  a  reasonable  minimum.  The  relative  importance  of  the  two 
measures  can  be  described  by  the  following  two  differential  equation^,  derived  from  the 
ratio  score  formula  S  =  _T_  x  100: 

T 


where 


ds 

dt 

~  x  100 

ds 

-T  x  100 

df 

ds  - 

first  derivative  of  ratio 

score 

dt  = 

first  derivative  of  time 

score 

df  = 

first  derivative  of  fuel 

score 

(1) 

(2) 


liquation  1  describes  the  average  rate  of  change  of  the  ratio  score  with  respect  to  time. 
Equation  2  describes  the  average  rate  of  change  in  the  score  with  respect  to  fuel.  Thus, 
rate  of  change  of  the  ratio  score  is  a  directly  proportional,  linear  function  of  time  and 
an  inversely  proportional,  nonlinear  function  of  fuel.  These  relationships  can  be  seen 
graphically  ii.  figure  4. 

The  subject  was  allowed  2  minutes  to  reach  criterion  performance.  If  he  did  not 
do  so  within  the  time  limit,  the  triai  was  terminated  and  he  was  assigned  a  ratio  score 
of  150  (the  arbitrary  limit  of  scoring  set  by  the  experimenter).  This  limit  also  could  be 
reached  by  expending  all  the  fuel  available  or  by  a  combination  of  time  and  fuel  expen¬ 
diture  without  exhausting  either  one.  (See  fig.  5.)  This  arbitrary  limit  was  exceeded 
in  slightly  less  than  6%  of  the  total  number  of  trials  (160  of  2688  responses)  in  the 
student  groups  on  the  two-dimensional  task.  Eighty-six  percent  of  the  maximal 
responses  (138)  in  turn  occurred  in  the  first  2  days  of  whole  task  training.  Less  than 
1%  of  the  pilots'  scores  (4  out  of  560  responses)  fell  into  the  maximal  response  category. 
The  minimal  score  possible  was  8  and  was  not  achieved  by  any  subject  in  the  experi¬ 
ment.  In  a  large  majority  of  the  cases  (7  2.5%),  a  maximal  score  was  attained  by 
expending  both  time  and  fuel.  The  time  limit  was  exceeded  in  20%  of  the  cases.  A 
total  distribution  of  the  scores  is  shown  in  figure  6. 


9 


'  ’JV 


rrw 


1 1  «x  m 


Frequency  Distribution  of  Ratio  Scores  for  All  Trials 
Blocks  of  10  Ratio  Scores 


SECTION  III 


;p^  9 


RESULTS 

A  graphic  representation  of  the  two-dimensional  task  data  is  shown  in  figure  7. 

The  data  of  the  student  groups  indicate  that  the  order  of  part  training  and  control/di  spin/ 
relationship  are  not  important  variables  in  the  acquisition  of  this  control  skill.  When 
the  student  groups  were  compared  statistically  using  the  analysis  variance  (table  I) , 
only  the  main  trial  effects  were  significant.  To  evaluate  the  student  groups  at  or  near 
asymptotic  level,  an  analysis  of  variance  was  performed  comparing  the  groups  over  the 
last  eight  trials.  The  analysis  (table  II)  indicated  that,  contrary  to  the  findings  of 
table  I  using  all  of  the  data,  the  outside-in  control/display  relationship  was  superior. 
Neither  the  trials  nor  order  of  part  training  variables  were  significant  over  the  last 
eight  trials . 

The  data  also  show  that  the  differences  between  the  pilot  group  and  the  student 
groups  diminishes  as  training  proceeds.  Two  of  the  student  groups,  C  and  D,  approach 
very  closely  the  pilots'  skill  level.  An  analysis  of  variance  performed  on  student 
group  C  vs  the  pilot  group  (table  III)  shows  the  pilots  to  be  superior  when  compared 
over  the  entire  series  of  trials.  Since  the  trials  by  groups  interaction  was  significant, 
a  t-test  comparing  the  pilots  with  student  group  C  on  the  last  four-trial  block  was 
conducted  and  showed  no  significant  difference.  (See  table  IV.)  A  t-test  comparing 
the  pilots  and  student  group  D  also  showed  no  significant  difference. 

A  comparison  of  skill  acquisition  for  student  group  C  and  the  test  pilots  on  time 
and  fuel  separately  are  shown  in  figures  8  and  9.  The  learning  curves  for  the  fuel  and 
time  scores  are  parallel  in  both  the  pilots  and  student  group  C.  However,  the  pilots 
appear  to  asymptote  on  fuel  score  much  earlier  than  the  students.  The  pilots'  curves 
are  not  as  closely  parallel  in  the  later  trials  because  they  have  not  reached  asymptote 
on  the  time  score.  Student  group  C  is  typical  of  all  the  student  groups. 

Analysis  of  the  part  task  training  (fig.  10)  shows  that  the  level  of  difficulty  of 
pitch  and  roll  are  practically  identical.  There  is  also  a  strong  indication  that  famil¬ 
iarization  on  one  dimension  positively  transfers  to  the  other  dimension. 
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TABLE  I 


ANALYSIS  OF  VARIANCE  FOR  STUDENT  GROUPS  OVER  ALL  TRIALS 
(TWO-DIMENSIONAL  TASK) 


Source 

df 

MS 

F 

C/D  Relationship 

1 

61,813 

.99 

Order 

Part  Training 

1 

75,163 

1.24 

C/D  x  Order 

1 

79,932 

1.  29 

Error 

20 

61,902 

Trials 

27 

110,925 

27.53* 

Trials  x  C/D 

27 

5,877 

1.45 

Trials  x  Order 

27 

4,079 

1.01 

Trial  x  C/D  x  Order 

27 

6,  245 

1.51 

Error  (within) 

4,030 

*Significant  .01  Level 


TABLE  II 

ANALYSIS  OF  VARIANCE  COMPARING  STUDENT  GROUPS 
ON  LAST  8  TRIALS  (TWO-DIMENSIONAL  TASK) 


df 

MS 

F 

Between  Subjects 

23 

C/D  (Error) 

i 

11, 256.70 

6.47* 

Order  (Error) 

i 

2,154.70 

1 .  24 

C/D  x  Order  (Error) 

i 

1,974.80 

1 .  14 

Error 

20 

1,738.65 

.... 

Within  Subjects 

168 

Trials  (w) 

7 

299.62 

.66 

Trials  x  C/D  (w) 

7 

874.45 

1.92 

Trials  x  Order  (w) 

7 

196.94 

.43 

Trials  x  C/D  x  Order  (w) 

7 

705.98 

1.55 

Error  (w) 

140 

456.08 

^Significant  .01  Level 
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TABLE  III 


SUMMARY  OF  THE  ANALYSIS  OF  VARIANCE 
ONE  GROUP  OF  STUDENTS  VS  ONE  GROUP  OF  PILOTS 


Source 

Sum  of  Squares 

df 

Mean  Squares 

F  Ratio 

P 

Groups 

350,221.74 

1 

350,221.74 

29.11 

0.01 

Ss  within  Groups 

108,283.45 

9 

12,031.49 

Trials 

1,050, 214. 35 

27 

38,896.83 

14.00 

0.01 

Trials  x  Groups 

224,490.62 

27 

8,314.47 

2.99 

0.01 

Trials  x  Ss  within 
Groups 

675,269.59 

243 

2,778.89 

TABLE  IV 

A  COMPARISON  OF  STUDENTS  AND  PILOTS  ON 
LAST  FOUR-TRIAL  BLOCK 


GROUPS 

Xx 

x2 

t 

sig 

Pilots  vs  C 

24.1 

21 .  1 

1.42 

.20 

Pilots  vs  D 

31.4 

21.1 

1.31 

.  1C 
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Figure  8.  Skill  Acquisition  on  Fuel  and  Time  (Group  C) 
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Figure  9 .  Skill  Acquisition  on  Fuel  and  Time  (Pilots) 


Figure  10.  Mean  Ratio  for  Four  Trial  Blocks  on  Part  Task  Training 


SECTION  IV 


DISCUSSION 

In  spite  of  the  fact  that  there  are  many  apparent  dissimilarities  between  the  pilot's 
task  in  controlling  the  aircraft  vs  the  space  vehicle,  the  experiment  suggested  no  nega¬ 
tive  transfer  effects  either  in  the  acquisition  data  or  in  any  qualitative  factors  observed 
during  the  conduct  of  the  experiment.  In  fact,  the  experimental  data  suggested  that  the 
pilot  group  benefited  from  their  prior  experience  as  pilots.  Part  of  this  beneficial  result 
is  probably  due  to  the  prior  experience  in  controlling  both  aircraft  and  simulators  trans¬ 
ferring  to  any  task  involving  controls  and  displays — in  ether  words,  a  familiarity  with 
the  general  situation  independent  of  the  specific  skills  required.  Also  involved  is  the 
more  specific  skill  of  having  manipulated  two-axis  controllers  before  entering  the 
experimental  situation,  whereas  the  students  have  not  had  this  experience.  Furthermore, 
the  pilots  were  familiar  with  the  particular  display  used  in  the  experiment,  the  MM-4 
attitude  indicator,  which  is  used  in  many  Air  Force  operational  aircraft.  Another  speci¬ 
fic  experiential  factor  that  benefits  the  pilot  is  his  background  in  integrating  primary 
and  secondary  displays  as  in  instrument  flying  and  in  some  emergency  situations.  The 
pilots  quickly  made  use  of  the  rate  meters  in  accomplishing  the  criterion  task.  In  the 
case  of  the  student  groups,  particularly  those  subjects  who  had  difficulty  in  the  early 
trials,  most  of  the  high  scores  were  traced  to  the  subject's  failure  to  use  the  rate 
meters,  causing  control  reversals  and  overshooting  the  target  attitude.  Thus,  we  see 
many  aspects  of  the  experimental  situation  that  favor  the  pilot.  In  addition,  the  pilots 
were  a  product  of  a  selection  procedure  that  was  based,  at  least  in  part,  on  aptitude 
for  such  tasks . 

The  task  variable  that  seemed  to  give  the  pilot  group  the  most  difficulty  was  the 
sensitivity  of  the  system.  The  most  frequent  error  made  by  the  pilots  was  over  con¬ 
trolling.  This  was  also  true  of  the  student  group  once  instrument  integration  was 
mastered.  Having  to  take  out  control  inputs  in  an  equal  and  opposite  fashion  to 
stabilize  the  display  at  a  given  attitude  was  the  other  feature  of  the  task  that  gave  the 
pilots  some  difficulty,  as  well  as  the  students.  The  pilots  also  expressed  some  dis¬ 
satisfaction  because  the  breakout  forces  of  the  control  were  too  small  in  contrast  to 
those  generally  encountered  in  aircraft.  There  were  also  cross-coupling  problems 
encountered  by  both  pilots  and  students  resulting  mostly  from  sudden  movements  in 
the  pitch  dimension  when  the  subject's  arm  was  not  properly  positioned  in  the  armrest. 

In  general  those  aspects  of  the  task  that  were  difficult  for  the  pilots  were  also  difficult 
for  the  students . 

The  fact  that  the  differences  between  the  students  and  pilots  were  appreciable  in 
the  early  phases  of  the  training  and  diminished  in  the  later  trials  is  attributed  to  the 
pilot  experiential  factors  discussed  earlier,  i.e.,  the  beneficial  effects  of  prior 
experience  were  washed  out  as  the  amount  of  training  increased.  This  result  is  true 
only  when  the  pilots  are  compared  with  the  two  better  performing  student  groups.  The 
diminishing  difference  between  these  groups  is  also  interpreted  to  mean  that,  as  the  amount 
of  training  of  student  groups  increases,  the  degree  to  which  one  may  use  the  data  to 
generalize  to  a  pilot  population  increases.  The  convergence  of  the  students'  data  and 
the  pilots'  data  also  indicates  that,  while  the  pilot  initially  has  an  advantage  in  this 
type  of  task,  his  advantage  can  be  overcome  with  training.  It  also  indicates  that 
training,  for  at  least  the  attitude  control  phase  of  space  flight,  may  well  be  feasible 
for  the  nonpilot. 
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Although  the  pilots'  learning  curve  appears  to  asymptote  at  approximately  the  100th 
trial,  this  does  not  necessarily  indicate  that  no  further  improvement  in  performance  is 
occurring.  A  closer  examination  of  the  data  shows  that,  even  though  the  mean  does 
not  change  over  the  last  16  trials,  the  standard  deviation  continues  to  decrease  and 
exhioit  a  downward  trend  at  the  end  of  training,  indicating  an  increase  in  reliability 
and  predictability  of  performance.  (See  fig.  11.)  Such  a  measure  is  particularly  useful 
when  information  about  consistency  of  performance  is  required.  An  example  of  such  a 
situation  would  be  where  a  man  must  back  up  a  fallible  automatic  system,  and  his 
absolute  minimal  predictable  performance  must  be  adequate  for  a  successful  mission. 
When  the  variability  measure  is  taken  into  account,  the  skill  levels  of  even  the  better 
student  groups  is  not  quite  as  close  to  the  pilots  performance  as  when  only  the  means 
are  compared.  In  terms  of  reliability,  then,  the  pilots  are  even  more  superior.  An 
illustration  of  this  can  be  seen  by  comparing  figure  7  with  figure  12.  Figure  12  shows 
a  plot  of  the  mean  (.99  prob.)  scores  which  were  computed  in  the  following  manner: 

a.  Subject's  individual  mean  score  is  computed  for  a  four-trial  block. 

b.  Subject's  individual  SD  is  computed  for  a  four-trial  block. 

c .  SD  is  multiplied  by  3 .  1  (value  of  Z  for  .99  L.  O .  C. ) 

d.  c  is  added  to  a,  yielding  .99  prob.  of  the  highest  score  subject  will 
obtain  in  that  block. 

The  comparisons  within  the  student  subgroups  pose  some  interesting  questions 
(fig.  7).  As  training  progresses,  the  effects  of  the  type  of  control/display  relationship 
become  noticeable.  Why  the  effects  of  this  variable  do  not  show  up  until  late  in 
training  is  not  clear.  However,  several  explanations  are  possible:  (1)  variability  due 
to  trial  effects  and  lack  of  skill  may  obscure  these  differences  early  in  training; 

(2)  sampling  error  or  high  variability  of  one  or  two  subjects  within  the  group  may  pro¬ 
duce  most  of  the  discrepancy;  and  (3)  negative  transfer  effects  may  show  up  late  in 
training.  The  third  explanation  is  considered  highly  unlikely.  The  second  does  show 
some  promise  in  that  two  of  the  subjects  appear  to  be  somewhat  different  from  the 
others,  but  not  enough  to  be  statistically  significant  as  tested  by  the  t c/a  statistical 
procedure,  described  by  Dixon  and  Massey  (ref  7).  In  the  opinion  of  the  author,  the 
high  variability  characteristic  of  early  learning  obscures  the  differences  that  show  up 
later.  The  finding  that  this  type  of  control/display  relationship  is  favorable  for  the 
naive  subject  is  not  new  (refs  1  through  4).  However,  these  earlier  data  were  gathered 
on  tasks  involving  the  tracking  of  a  forcing  function  and  were  rate  control  tasks.  The 
vehicular  control  task  used  in  this  study  did  not  use  a  forcing  function  and  involved 
acceleration  control.  Although  the  experimental  data  favor  an  outside-in  type  of  display 
for  this  type  of  task  on  nonpilot  subjects,  more  extensive  training  probably  would 
eliminate  any  differences.  Gardner  (ref  4)  reports  that  his  subjects  did  not  overcome 
such  a  disadvantage.  However,  his  subjects  were  trained  over  40  trials,  which  is 
probably  an  insufficient  amount  of  training  to  overcome  unfavorable  control/display 
relationships.  Data  reported  by  Cotterman  (ref  8)  indicated  that  order  of  part  training 
may  interact  with  control/display  relationship,  but  the  present  experiment  did  not 
indicate  that  such  was  the  case. 

The  part  training  of  the  single  dimensions,  apart  from  assessing  order  effects,  was 
extremely  useful  for  this  type  of  task.  In  the  first  place,  the  vehicular  control  task 
used  here  is  very  difficult  and  confusing  initially  and  many  smaller  skills  have  to  be 
learned,  e.g.,  use  of  meters,  developing  efficient  scanning  patterns,  and  using  the 
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Figure  11.  Comparison  of  Students  and  Pilots  SD  on  Two-Axis  Control  Task 
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Figure  12.  Comparison  of  Students  and  Pilots  Mean  Scores 
on  Two-Axis  Control  Task 


control.  How  the  subject  performs  also  depends  on  his  adaptability  to  the  new  situation, 
understanding  of  instructions,  learning  "how  things  work"  and  other  variables  of  a 
transient  nature  that  are  frequently  irrelevant  to  the  experimenter's  investigation,  but 
may  affect  early  phases  of  the  experiment.  A  period  of  preliminary  learning  prior  to  the 
whole  task  presentation  reduces  confusion  in  the  subject  and  also  decreases  intra¬ 
subject  variability  prior  to  training.  This  reduction  in  error  variance  makes  later  experi¬ 
mental  comparisons  more  precise,  for  example,  during  the  preliminary  training  there 
were  several  instances  of  "insight  learning"  of  the  use  of  the  rate  meters  on  the  part  of 
the  students.  This  caused  sudden  changes  in  technique  of  solving  the  problem  that 
could  confound  results  had  this  insight  occurred  during  whole  task  training.  The  bene¬ 
ficial  transfer  effects  from  one  dimension  to  the  other  on  the  part  task  training  are 
probably  due  to  becoming  familiar  with  the  apparatus,  the  principles  involved  in  accel¬ 
eration  control,  and  the  extraction  of  information  from  such  a  display. 

An  interesting  finding  on  the  one-  vs  two-axis  task  was  that  following  part  training 
on  each  dimension  the  subject's  score  on  the  two-dimensional  task  was  not  the  sum  of 
his  average  scores  on  the  single  dimensions  or  even  close  to  it.  One  might  expect  a 
simple  summation  to  be  the  case,  since  the  two-dimensional  task  was  typically  attacked 
one  dimension  at  a  time.  The  nonaddativity  is  illustrated  in  figure  13  in  the  pilots' 
data  and  also  holds  true  for  the  other  groups.  Thus  part  task  training  does  not  completely 
transfer  to  the  whole  task;  and  the  whole  in  this  case  is  not  the  sum  of  the  parts.  Of 
course,  there  were  many  instances  in  which  subjects  would  lose  the  first  axis  while 
putting  the  second  on  target,  which  would  account  for  the  disproportionately  higher 
scores  on  the  two-dimensional  task.  There  were  also  instances  where  the  subject 
would  attempt  to  control  both  dimensions  at  the  same  time,  which  was  almost  always 
unsuccessful  except  toward  the  end  of  training,  and  even  then,  if  the  subject  did  not 
succeed  in  his  first  attempt,  he  would  ultimately  get  an  inordinately  high  score.  One 
of  the  pilot  subjects  consistently  controlled  both  dimensions  at  once;  he  received  a 
relatively  greater  number  of  low  scores,  but  he  also  showed  the  most  variability  in  his 
performance. 

An  interesting  sidelight  to  the  experiment  was  the  observation  that  there  was  a 
great  deal  of  variability  in  the  way  the  pilots  used  the  primary  display.  Some  subjects 
flew  to  the  horizon  while  others  flew  the  case  around  the  instrument,  indicating  that  a 
display  is  not  always  used  the  way  the  designer  anticipates.  Two  of  the  pilots  also 
commented  that  the  lack  of  motion  cues  sometimes  led  to  control  reversals. 
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SECTION  V 


CONCLUSIONS 

1.  There  appears  to  be  more  positive  transfer  than  negative  transfer  effects  in 
transitioning  from  flying  aircraft  to  a  simulated  inertial  control  task. 

2.  The  degree  to  which  generalizations  can  be  made  from  students  to  pilots  on 
this  type  of  task  depends  on: 

a.  The  amount  of  training — the  more  training  trials  the  greater  the  degree 
of  generalization  recommended. 

b.  Optimal  training  conditions  for  the  students — in  this  case  using  "outside- 
in"  rather  than  "inside-out"  displays,  although  the  amount  of  training  probably  deter¬ 
mines  this  requirement. 

3.  Previously  untrained  subjects  can  achieve  skill  levels  comparable  to  pilots  on 
this  type  of  task,  although  it  takes  more  trials  for  the  nonpilot  to  do  so. 

4.  Order  of  part  training  on  this  kind  of  task  does  not  appear  to  be  an  important 
variable  in  training. 
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